A brief overview of my 
latest explorations 




Terrains 



Underlying patterns exist in every aspect of reality as we know it. Some of the most 
basic and apparent ones are part of the everyday experience we absorb everyday in the 
form of countless millions of sensory stimuli. 



For this group of works, the image is chosen as the basis for dealing with patterns from 
all of these realms. 



Basic sensory forms include pattern and regularity of the visual world, one that on the 
most basic cortical levels is a planar map. Converting this sensory experience into a 
time dependant form preserves the features and charactaristics, but suspends them into a 
temporal existance 

Other sensory experience over time, such as sound retains the vital elements of pattern 
of occurrence and amplitude. This present body of work doesnt extend on a fine level 
into the frequency domain 

The touch realm directly acquires textural aspects of surfaces and materials, and stores 
them for use in waves and compositions. A special piece of equipment under 
development, the Terra-Stylus' records vibrations when dragged across a surface 



A Brief History 
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A bit about a few pieces posted on archive.org 

The Moonscan recordings were made in the years 
1999-2000, when I was exploring the relationship 
between fractals, natural systems and music. 
These recordings were made during the time I 
was developing a software application that reads 
visual data, and turns it into midi data, and music. 
The pictures are scanned and then filtered by the 
manipulation of translational processes in the 
software, which dictates how the resulting music 
sounds. 

Moonscan 1 - 8 get their original content from 
NASA lunar landscape images. 



http : //www. archive . org/details/moonscan 1 
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Above moon mage mapped according to musical 
rules. Encoded in this image are pitch, velocity, 
time values etc. 



The Present: 



Has been working on various methods of acquiring and translating 
patterns of the natural world. This multi-sensory journey yields 
countless sources of compositional textural and waveform 
material for visual and sonic compositions. 




Visual data is extracted from found images, drawn visual scores, 
and adaptations of algorithmically generated visual fields. 
Data is also gathered from a variety of sources from other sensory 
domains, including sound, and touch. The sound conversions are 
a software process, where the latter requires custom sensors and 
electronic equipment. 

Other processes, such as 'text to sound 1 (on the micro level ) or 
'text to structure' (on a more macro level ) may borrow patterns 
from available data sources, including literary works, genomes, 
weather, and astronomical data. 



This process eventually led to generating and manipulating 
images for the sole purpose of making sound and compositions. 



My present-day experiments in this field lead to a rather 
large variety of custom software applications for whatever 
specific need arises. The programming environment used 
depends on the shortcomings for a particular platform 
(mine, or those of the language itself). Currently image 
data is ingested into a VB application, and converted into 
binary or text files. Binary files are used for direct import as 
raw wave data. The text files are normally structured in 
specific formats for parallel sonification processes. 
Normally data derived from images is based on 8 bit fields, 
which makes the most sense when dealing with the most 
common 24 bit color format. Normal text output formats I 
use are 8 bit monochrome, RGB 3 column format, and 8 
and 16 column monochrome formats. These formats are 
convenient when mapping to various parameters in custom 
applications in Max/MSP and PureData. These applications 
are normally the end users of the data, but I have Max 
bridge programs that filter and send the data as MIDI to 
many other commercial apps and external MIDI 
instruments. 




Text file resulting from scanning a scanned image. The file is eventually 
mapped to any number of various synthesis parameters 
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A 16 column text file, meant for sampling of regularly spaced image data attributes for the 
purpose of parameter mapping. 



_§'. row16score1Jpg.txt - Notepad 
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Data Acquisition 
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Translational Processes 
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Moon image mapped according to multiple sets of musical rules, reassembled for the purpose 
of waveform generation. 



On the Macro Level 




Visual score for the purpose of phrasing and movements 
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Phrasing and development 
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Two scores designed for simultaneous piece processes: track mixing and rhythmic 
pattern generation. Images from this series have also been used for waveform generation. 




Point-event distribution 





Algorithmic Generation of waves/patterns for the purpose of re-composition re- 
sampling in the visual realm 





Probability Processes 

Uniform Fields 
o 



definitions composing with large numbers of discrete tones 

Matrix instrument 
f 
Tonal field generators / tonal field applications Bonification techniques 



Tonality 



hyperchromatic realms I freezer applications 

\ ^ Types j Reverberation / - 

\ Theories/definitions 



Anatomy of noise 
noise fields / — 



~ y g radient between tonali ty and noise 
Anatomy of noise Anatomy of noise, , 
Microtonal multitimbral synthesizer 



Microtonality / Microtuner 



Scala Application 



I Processes 



d noise 

rapidly morphing periodic sounds due to differing lengths of transverse resonance/interference 



periodic sounds 



nonperiodic sounds 



\ in the real world, periodic waves tend to change overtime 
sounds that have an extremely low repetition of; 



Anatomy of noise 



deviation from natural series / 
^ harmonics f 



! series arbil uiged in series 



arbitrary partial amplitude relati onships 
Uses ofthe natural harmonic series Generating 

Natural sources 



generated noise 
acquired noise 



Components 
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Score for a periodic wave 




Remapping images for 
sonification purposes 
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Images remapped in a modulated elliptical scan format to minimize the 
periodic nature of a simple raster scan method 



Vector to raster mapping 



Graphical 



Remapping 



Compos 



Planar remapping 



Stamper 



\ Pixel pjet 
changing location; 
a vector scanned i 



Translational Processes 



Data 



Text Processing 



Feature Detection 
Text to text translation 
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Text to Imai 



V Sound f 



particula jxtis used 



Image to Sound 



Definitions of rev general theories 
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Successive Remapping 




Any given image is a finite system, with its own histogramic, 
frequency and angularity charactaristics. Remapping changes 
the trajectory the latter mentioned traits, while preserving the 
former. The same basic raster scanning process is given the 
ability to move in any direction, because of the remapping. 
The results are then able to be manipulated in the visual realm. 
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The result of a translational process, though it can look 
much different, cant escape some basic charactaristics of 
the original 





Fourth iteration of moon image remapped with the same modulated 
elliptical trace pattern 



Probability Processes 
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Software created for designing elliptical scan trajectories 



Q Mapping Designer 
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Hardware 




Examples of specialized machinery for aquiring/using terrain 
data 




Remote terrain gathering device, single pixel 
camera/recorder intended for use on a moving vehicle or 
platform also the optical capture of film or human 
movements. Output is selectable as either MIDI or 
RS232 format, for use in sonification processes. 




Prototype of a turntable style scanner for reading 
helical format visual scores and other various 
image meterial for production and live 
performance. Output is MIDI Continuous 
controller data, which can be mapped to any 
musical attribute, or via a standard rs232 
connection, mapped directly to sonic waveforms 
and other data processing programs . 



